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EVOLUTIONARILY INDUCED ALTERNATIVE STATES AND COEXISTENCE IN 

SYSTEMS WITH APPARENT COMPETITION 

SEBASTIAN J. SCHREIBER AND SWATI PATEL 


Abstract. Predators often consume multiple prey and by mutually subsidizing a shared predator, the 
prey may reciprocally harm each other. When predation levels are high, this apparent competition can 
culminate in a prey species being displaced. Coupling quantitative genetics and Lotka-Volterra models, 
we study how predator evolution alters this and other ecological outcomes. These models account 
for a trade-off between the predator’s attack rates on two prey species. We provide a mathematical 
characterization of a strong form of persistence-permanence-for which there is a global attractor bounded 
away from extinction. When the evolutionary dynamics occur at a sufficiently slower time scale than 
the ecological dynamics, we also characterize attractors and their basins’ of attraction using singular 
perturbation theory and a graphical approach to the eco-evolutionary dynamics. Our results show 
that eco-evolutionary feedbacks can mediate permanence at intermediate trade-offs in the attack rates. 
However, at strong trade-offs, permanence is lost. Despite this loss of permanence, there can be attractors 
supporting coexistence. These attractors, however, may coincide with attractors at which the predator 
is excluded. Our results highlight that evo-evolutionary feedbacks can alter community structure by 
mediating coexistence or leading to trait-dependent alternative stable states. 


1. Introduction 


Ecological communities consist of complex webs of interacting species, each of which contain phe- 
notypically diverse individuals. Species interactions including competition, predation, and mutualism, 
generate nonlinear feedbacks that determine community composition and stability. These feedbacks 
are the key focus of community ecology theory. Within each species, individuals often differ in many 
traits including gender, size, behavior, or physiology. This variation provides the raw material for 
natural selection and thus is a key focus of evolutionary theory. Traditionally, evolutionary biologists 
and communit y eco logi sts de veloped theory and ran experiments without considering the other disci¬ 
pline |Fussmann et ah . 2007]. This separation stemmed from the traditional belief that ecological and 
evolutionary processes occur on vastly different time scales. However, in Schoeneil |201ll ] ’s review of “the 
newest synthesis”, there is growing empirical evidence that feedbacks between ecological and evolution¬ 
ary processes occur on more commensurate time scales (e.g. tens to thousands of generations instead 
of hundreds of thousands of generations) and the effects of these feedbacks can be sub stant ial. Hence 


n 


Jothing in evolution or ecology [may] make sense except in the light of the other” Pelletier et al. 


2009]. A major challenge facing this synthesis, “is whether the persistence of interactions and the 


stability of communities truly rely upon ongoing rapid evolution or whether such rapid evolution is 
ecologically trivial” Thompson |l999 |. Here we confront this challenge for the “apparent competition” 
community module in which two prey species share a common predator species. 

Predators often consume multiple prey. By mutually subsidizing a sh ared predator, the prey species 
may reciprocally harm each other and, thereby appear to be competing |Holt . 1977 . Holt and Lawton . 
1993 . 19941 ] . Thes e negatively reciprocal r e spons es have been demons trated empirically in plant- 
herbivore systems Rand . 20031. Rand et all. 2004 ]. insect communities (Mueller and Godfravl. 1997 . 
Rott and Godfravl. Il998l Morris et all. 12001 ]. and hosts sharing common pathogens Tompkins et al. . 





































































20001. Cobb et all 201 0]. When prey are not resource limited or predation pressure is strong, mod¬ 
els predict th at apparent com p etitio n can lead to the exclusion of one of the prey species - dynamic 
monophagy (Holt and Lawtoni . Il994l ]. 

From the perspective of the predator, attacking multiple prey m ay ensure greater energetic gains 
or provide insurance against the loss of a focal prey species (MacArthur . 19551 ] . To what extent these 
benefits exist depends largely on the trade-offs between the abilities of attacking the different prey 
species. For example, man y predator species optimal atta ck rate occur at an intermediate ratio of 


predator to prey body sizes (Brose et ah . 2006 . Brose . 2010l |. Hence, predators experience a size trade¬ 


off between being larger to optimize attack rates on larger prey and being smaller to optimize attack 
rates on smaller prey. 

Early work on the evolution of a predator attacking two prey species has focused on the conse- 


tor Wilson and Turelli. 

1986 

Nurmi and Parvinen. 

20131. 


Schreiber and Tobiasonl . 120031 iRueffler et al.l. 120061 I Abram si. l2006aUb . 


utilization of two prey species, Wilson and Turellil |l986 


illustrated that there can be selection for 
polymorphic predators in which, surprisingly, the heterozygous individuals are the least fit. More 


recently, ISchreiber et al.l [201 ll ] used a quantitative genetics framework to examine how phenotypic 


variation in a predator affects ecological outcomes. They found that eco-evo feedbacks can marginalize 
or even reverse the negative effects of apparent competition and mediate coexistence of the prey species. 
Furthermore, at sufficiently strong trade-offs, the eco-evolutionary dynamics exhibit alternative stable 
states. This study, however, did not examine how trade-offs influence predator persistence or provide 
mathematically rigorous proofs of their results. 

Here, we provide a mathematically rigorous verification of the results of Schreiber et ah |201l| and 
explore how trade-offs influence predator as well as prey persistence. In section 2, we introduce the 
model which couples Lotka-Volterra dynamics for apparent competition with a quantitative genetics 
model for the predator trait. In section 3, we study a strong form of persistence, namely permanence 


at which there is a global attractor bounded away from extinction Hutson and Schmitt, 11992 ], We 


characterize permanence and examine how the strength of trade-offs influences permanence. In section 
4, we refine our analysis of the eco-evolutionary dynamics using singular perturbation techniques and 
provide estimates for the size of the basins of attraction for the stable equilibria of eco-evolutionary 
dynamics. Coupling these results with a graphical approach to the eco-evolutionary dynamics, we 
explore the attractor structure of the eco-evolutionary dynamics and identify under what conditions 
there is conditional coexistence of all three species. In section 5, we conclude with a discussion of the 
main implications of our work and highlight future research directions. The proofs of the main results 
are presented in sections 6 and 7. 


2. Coupling the Ecological and Evolutionary Dynamics 

There exist a variety of ways that modelers have coupled ecological and evolutionary processes. These 
approaches differ in whether the traits under selection are discrete or continuous, the underlying ge¬ 
netic architecture and processes (e.g. clonal evolution of haploid individuals versus diploid individuals 
with recombination), and whether the entire trait distribution is modelled. Here, we use a quantitative 
genetics framework which assumes a continuo us trait and bears som e similarities to the adaptive dy¬ 
namics approach. We develop the model from Schre iber et ah 2011] step by step to illustrate how the 


quantitative genetics framework can be used to develop models with eco-evo feedbacks, and to highlight 
the assumptions underlying these models. 

We begin by describing the ecological dynamics in the absence of evolution. These dynamics involve 
a predator population with density P consuming two prey species with densities N\ and N 2 . Each prey 
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species i exhibits logistic dynamics with intrinsic rate of growth r* and carrying capacity 7Q. The attack 
rate of the predator on prey species i is a*. The conversion efficiency e* determines how the number 
of prey i eaten by the predator convert to new predator numbers, and d is the predator’s per-capita 
death rate. Hence, the ecological dynamics are given by 

dN> = r-jAyi - Ni/Ki) - PaiN, 

( 1 ) 


dt 

dP 


dt 


= P{e\a\Ni + eidiiVi — d) 


Takeuchi and Adachil 1983 ] proved that this Lotka-Volterra system always has a globally stable equi¬ 


librium that either supports all three species (coexistence), both prey species (predator exclusion), or 
the predator and one prey species (prey exclusion). These outcomes can be determined by examining 
the per-capita growth rates of missing species from the boundary equilibria. 

To overlay the evolutionary dynamics on top of the ecological dyn amics, we take a quantitative 


genetics approach, sometimes playfully called “Lande Land” (Lande . 1976 ], In Lande Land, each 


individual predator’s phenotype is determined by a continuous trait x. This trait determines the 
predator’s attack rate cp(x) on each of the prey species i — 1,2. The attack rates a;(x) are maximal at 
an optimal trait value x = 9i and decrease away from this optimal trait value in a Gaussian manner, 

where cp is the maximal attack rate and T; determines how steeply attack 


i.e 


cii(x) = ai exp 


(x-6j) 2 


2rf 


rate declines with distance from the optimal trait value. In effect, r,; determines how phenotypically 
specialized a predator must be to use prey i. 

This model of the attack rates mimics the common empirical situation in which quantitative trait vari¬ 
ation in a predator influences individuals relative use of alternative resources. For predator-prey interac¬ 
tions ranging from terrestrial predators of arthropods to aquatic predators of zooplankton lBrosel.l2010[ 


the attack rate of a predator is optimal at intermediate predator-prey body size ratios (Brose et al.l. 
2006]. When predators attack prey of different sizes, there is an inherent trade-off between being larger 


to better attack the larger prey species and being smaller to better attack the smaller prey species. Al¬ 
ternatively, individuals of threespine sticklebac k (Gasterosteu s acul e atus) preferentia l ly con sume either 


benthic insect larvae or limnetic zooplankton [lArauio et al.l. 2008 . Matthews et ah . 20101. For these 


populations, gill raker length or number are approximately normally distrib uted , and individuals at 
different ends of this distribution tend to consume different prey types [Robinson . 2000 


In Lande Land, t here a re two main assu mpt ions. First, the trait remains normally distributed in the 
population (Lande . 1976 . Turelli and Barton] . 1994 ], This assumption corresponds to the trait being 
determined by additive contributions of many independent loci. Second, the variance cr 2 in this trait 
remains constant over time. This assumption allows for moment closure: when it holds, the mean trait 
value determines the entire distribution. While this assumption is likely to be violated over longer- 
time scales, it provides an analytically tractable, first approximation to the full distributional dynamics. 
While epistasis, linkage disequilibrium or geno type-by-e nvironment interaction can generate substantial 
deviations from a normal trait distribution, Turelli and Barton |l994 | showed numerically that the 
normal approximation still gives remarkably accurate predictions for dynamics of the mean and variance 
of the trait value under a wide variety of assumptions. Under weak assumpti ons, even frequency- 
depe ndent disruptive selection maintains a nearly Gaussian trait distribution (Burger and Gimelfarb . 


2004 


Let x and cr 2 be the mean and variance of this normally distributed trait. The phenotypic variance 
a 2 = crQ + crg has a genetic and an environmental component. The environmental component a% corre¬ 
sponds to non-heritable variation in the trait e.g. individuals that developed in different environmental 
backgrounds. The phenotypic variation in the trait, whether heritable or not, influences the ecolog¬ 
ical dynamics due to nonlinear averaging of the attack rate at the scale of the predator population. 
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Specifically, the average attack rate on prey i is 

/•OO 

ai[x) — / cii(x)p(x, x) dx = 




where p(x, x) = exp 


J — OO 

(x—x) 2 

2a 2 


(x - 0, f 

2(a= + r?) 


: exp 


, is the density of the normal distribution with mean x and variance 


a 2 . 


Under the assumptions of a normally distributed trait with fixed variance, Lande 1976 | showed that 
the rate of change of the mean trait is given by 


dx 


dW 


= ov 


dt G dx 

where W is the average per-capita growth rate or fitness of the evolving species. Here, 


W = e,a,(x)A^ — d 

i—1 

for the predator. In words, the rate of change of the mean trait is proportional to the genetic variance 
of the trait and the gradient of the fitness. Intuitively, evolution selects for increasing fitness. However, 
due to ecological feedbacks, the graph of the fitness function, “the fitness landscape”, may change as 
the trait changes, leading to eco-evo feedbacks. 

Putting all the pieces together, we get that the ecological and evolutionary dynamics are given by 


dN,. 


= r i N i (l-N i /K i )-a i (x)N i P 


( 2 ) 

where 

(3) 


dt 

dP - 
— = PW 
dt 


dx 

dt 


= er, 


G' 


DW 

dx 


dW 

dx 


2 

EeiNiTiOtiiQi - x) 

/_2 , -9V./9 eX P 


1=1 


(r 2 + a 2 ) 3 / 2 


(x - 

_ 2(r 2 + a 2 ) 


The state space for these dynamics are x M where M + = [0, oo). 


3. Permanence 

We begin by examining the conditions that ensure that all three species coexist in the sense of 
permanence, and how the strength of the trade-off affects these conditions. We say our system is 
permanent if there exists (3 > 0 such that 

1/(3 > limsupmax{IVi(£), N 2 (t), P(t)} > lirninf mm{Ni(t), N 2 (t), P(t)} > (3 

t^roa t-Too 

for all initial positive population densities (A r i(0)W(0)P(0) > 0) and any initial phenotype in x(0) G M. 

To evaluate permanence for our eco-evolutionary system, we begin by considering the dynamics 
in each two-species subsystem. For the predator-prey subsystem ( Ni,P,x ), the following proposition 
implies that the predator evolves to specialize on the present prey and may or may not persist with 
that prey at that phenotype. This proposition states the result for i — 1, but also applies for i = 2. 

4 























Proposition 3.1. Assume JV 2 (0) = 0 and iV 1 (0)P(0) > 0. If e\ai( 6 i) > d, then 

lim(N 1 (t),P(t),x(t))= ( d , 

Alternatively, if eiai(6 l 1 ) < d, then 

lim (iVi(t), P(t),x(t)) = (Ki, O,0i). 

t —^OO 

For the two prey subsystem, we have the following characterization of the eco-evolutionary dynamics. 
Proposition 3.2. Assume P( 0) = 0 and Ni(0)N 2 (0) > 0. Then 

lim (iVi(f), N 2 (t),x(t)) = (K 1 ,K 2 ,x*) 

t—> oo 

for some x e Q = {x e K 2 ,x) = 0} 

We remark that for the single prey subsystem (i.e. P(0) = iVj(O) = 0, iVj(0) > 0;z ^ j), one can 
easily verify that 

lim (Ni(t),x(t)) = (Ki, Of). 

t—> OO 

In Proposition 13.21 Q is the set of fitness extrema when both the prey are at carrying capacity. We 
prove both propositions in section 6. By examining the per-capita growth of the absent species in 
these subsystems, in which either the predator or prey is excluded, we get the following theorem for 
permanence in our eco-evolutionary system: 

Theorem 3.1. Let Q = {x G R|^(lFi, K 2 , x) = 0} be the set of fitness extrema when both the prey 
are at carrying capacity. If 

( a ) Tjfe) > - a,j(Oj)ejKj ) for i = 1 , 2 -i^j and 

(b) W(Ki, K 2 , x*) > 0 for all x* G Q 
then the system is permanent in x R. 

Conversely, if the inequality in condition (a) or (b) is reversed, then the system is not permanent. 
In particular, if the inequality in (a) is reversed for i = 1 (2, respectively), then the equilibrium point 
ri {\— At) r2 (l_i^2) 

W) ’ °- ai(flf) 1 > 0i) T(°> e 2 at(e 2 ) ■ 0 . 2 ( 62 ) ’ res P ectivel v) is stable. If the inequality in condition (b) 


K e\a\ 


is reversed for some x* G Q, then there exists initial positive population densities (Ni(0)N 2 (0)P(0) > 0) 
and phenotype x(0) such that 

lim (Ni(t), N 2 (t), P(t),x(t)) = (K u K 2 ,0,x*) 

t—t OO 

Note: We conjecture that in fact the conditions for permanence ensure robust permanence (see, e.g., 
Schreiber] 2000j |). 

We can use this theorem to infer how the trade-off and carrying capacities affect permanence (Fig. [T]). 
The strength of the trade-off, measured as \d 2 — 6 i\, has two main effects on permanence, that cumu¬ 
latively result in permanence only occurring at intermediate trade-offs. First, strong trade-offs affect 
prey persistence. Let us assume that > a J(o 2 ) w hich case condition (a) is always met for prey 1 

1. e. prey 1 always persists, independent of the trade-off. If the carrying capacity of prey 1 is sufficiently 
large and there is no trade-off (i.e. 61 = 9 2 ), then the equilibrium only supporting prey 1 and the preda¬ 
tor is stable and the system is not permanent. However, increasing the trade-off \0 2 — 9f\ decreases the 
attack rate, 02 (^ 1 ), on prey 2 when the predator is specialized on prey 1. Hence, condition (a) for prey 

2, is more easily satisfied at stronger trade-offs (e.g. prey 2 persists provided 1 9\ — 9 2 \ > 0.75 in Fig. Q]). 
Second, the strength of the trade-off determines the shape of the fitness landsca pe and cons equently, 

the set Q of fitness extrema in condition (b). For T\ — r 2 , we have shown elsewhere Patel and Schreiberl . 
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Figure 1. The effects of trade-off strengths and carrying capacities on permanence. In 
this bifurcation diagram, prey 2 is the inferior prey species (i.e. has the lower value of 
r i/oji{6i)). At intermediate trade-offs, the system is always permanent. At weak trade¬ 
offs, permanence is lost due to the inferior prey species being unable to invade. At strong 
trade-offs, the predator can only conditionally establish. The graphs in these regions 
correspond to fitness landscapes W when both prey are at their carrying capacities. 
Parameters: rq = l,r 2 = 0.25, K\ = 100, aq = a 2 = 0.01, T\ = t 2 = 0.4, a = 0.3, e\ = 
e 2 = 0.5 ,and d = 0.1. 


In review] that \0 2 — 9i\ < 2 \/a 2 + r 2 implies that the predator fitness landscape is unimodal with a 


single fitness maximum (see fitness curves in Fig. [T] for \9 2 — 9i\ ~ 1). Thus, for weak trade-offs it 
suffices to check the growth at this optimal phenotype for when the prey are at carrying capacity. 
Alternatively, for \0 2 — 6\\ > 2a/ct 2 + r 2 , the fitness curves can have multiple extrema, typically with 
two fitness maxima near the specialized phenotypes and one minimum at intermediate phenotypes when 
the prey are at carrying capacity (see fitness curves in Fig. |T] for \0 2 — 9i\ ~ 2.5). For sufficiently strong 
trade-offs, the predator will not have positive growth at intermediate phenotypes, and specifically at 
the fitness minimum, as it cannot attack either prey efficiently. Hence, the system is not permanent 
at sufficiently strong trade-offs as there are initial conditions leading to the exclusion of the predator. 
Furthermore, as shown in Fig. [U if one of the prey has a sufficiently low carrying capacity, then there 
is a stable equilibrium excluding predators experiencing strong trade-offs. However, coexistence is still 
possible in a weaker sense as we discuss in the next section. 

6 









4. A FAST-SLOW APPROXIMATION 


To refine our understanding of the eco-evolutionary dynamics, we observe that the phenotypic dy¬ 
namics occur at a slower time scale than the ecological dynamics. Hence, as a first approximation, 
we consider the limiting case of when the ecological dynamics are much faster than the evolutionary 
dynamics. To perform this time scale separation in a quantitative genetics framework requires a bit 
of care as the genetic variation a q which scales the rate of change x in the phenotypic dynamics also 
influences the ecological dynamics through the phenotypic variation term a 2 = (Jq + a 2 E . To separate 
out these effects, we consider the heritability of the phenotypic variation 


h 2 = 


cr, 


G 


er 


which varies between 0, when none of the phenotypic variation is inherited, and 1, when all the pheno¬ 
typic variation is inherited. For a fixed level of phenotypic variation cr 2 , varying K 2 only influences the 
speed of the evolutionary dynamic and has no immediate effect on the ecological dynamics. Hence, for 
our fast-slow approximations, we assume that o 2 is fixed and we vary the speed of evolution by varying 
h 2 . 

If h 2 = 0, then x remains constant and the dynamics of (|2]) c orrespond to t he classical Lotka- 


Volterra dynamics of two prey species with a common predator. Takeuchi and Adachi 1983 ] have 


studied these dynamics in great detail and have shown (cf. Theorem 6 with a = /3 = 0) that all of the 
positive solutions of these equations converge to a unique stable equilibrium, call it (N\ (x), N 2 (x), P(x)), 
whenever all species are initially present. This equilibrium can either support all three species (i.e. all 
components are positive), only the prey species (i.e. only the first two components are positive), or the 
predator species and only one of the prey species (i.e. one of the first two components is zero, the other 
components are positive). The graph of this function, £ = {( N\{x ), N 2 (x), P(x),x)\x E [9i, 9 2 \}, defines 
a piecewise smooth, one dimensional manifold homeomorphic to [9\,9 2 ] that is a global attractor for 
the dynamics of (J2]) when h — 0 i.e., all solutions with all species initially present converge to £. 

When h 2 is positive but small, we can approximate the dynamics of the fully coupled system with 
the fast-slow approximation: 


(4) 


dx l9 2 dW,~ ._. - , .. 

Tt = \ a 

Ni(t) = Ni(x(t)) and P{t) = P(x(t)). 


Since (Ni(x), N 2 (x), P(x)) is piecewise smooth and continuous, the same holds for the right hand side 
of (gD. In particular, the right hand side is Lipschitz and, conse q uentl y, solutions exist and are unique. 

Using geometric singular perturbation theory (see, e.g., Hekl [2010 ] for a nice review), we prove the 
following theorem. This theorem provides a sufficient condition for the existence of a stable equilibrium 
for the eco-evo dynamics and an estimate of the size of its basin of attraction. 

Theorem 4.1. Let [a, b] be a subinterval of [9 1 , 9 2 ] andx* E (a, b) be a trait value at which (Ni(x), N 2 (x)) 
is continuously differentiable. If 4|h(iVi(x), N 2 (x), x) > 0 for all x E [a, x*) and ^-(Ni(x), N 2 (x)) < 0 
for all x E (x*, b\, then for all 6 > 0 there exists h 0 > 0 such that solutions of (JS])-© satisfy 

lim(7V 1 (t),A r 2 (t),P(t),x(t)) = 


,x 


£—>•00 


whenever N\(0)N 2 (0)P(0) > 8 , x(0) E [ a,b\, and 0 < h < ho. 

Note: We conjecture that ho in the statement of Theorem 14.11 can be chosen to be independent of 

5 > 0 . 

To apply Theorem 14.11 we use a graphical approach in the plane where the horizontal axis corresponds 
to the mean trait value and the vertical axis characterizes the quasi-stable-equilibria of the ecological 











Ni/(Ni + N 2 ) Ni/(Ni + N 2 ) 



phenotype x 


phenotype x 



phenotype x 


phenotype x 


Figure 2. Graphical representation of the eco-evolutionary dynamics for low heritability 
( h 2 ~ 0). Black solid lines correspond to the ratio of N ~^ N „ at the ecological quasi- 
stable states i.e. the ecological nullcline. Dashed red lines correspond to where jjj — 0 
i.e. the evolutionary nullcline. In the fast slow limit, the dynamics converge toward 
the ecological nullcline and move to the right or left depending on whether ^ > 0 
or < 0. Eco-evolutionary equilibria occur at the intersection of these nullclines. 
Theorem 14.11 implies the black equilibria are stable. Parameters: rq = l,r 2 = 0.25, 
K\ = 100, a.\—a 2 — 0.01, T\ = r 2 = 0.4, a = 0.3, e\ = e 2 = 0.5, and d = 0.1. 
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dynamics (Fig. [2]). We use the fraction N ^ Ni> at the quasi-stable-equilibria to characterize the ecological 
state of the community. This ratio equals zero if prey 1 is excluded, and equals one if prey 2 is excluded. 
When the predator is excluded this ratio equals K *+ K • Any other value of this ratio (i.e. not 0, 
Ki/(Ki + K 2 ), or 1) corresponds to a quasi-stable-equilibria for which all three species coexist. 

The graphical approach continues by drawing two curves in the rectangle [ 81 , 62 ] x [0,1]. The first 
curve, “the ecological nullcline”, corresponds to the graph of quasi-stable equilibria for the ecological 
dynamics i.e. the graph of the function: 


Ni{x) + M*Y 

As the points along this curve correspond to globally stable equilibria for the ecological dynamics, 
the eco-evo dynamics “rapidly” approach and move along these curves in the fast-slow limit. These 
ecological nullclines correspond to the solid black curves in Figure [2] 

The second curve, “the evolutionary nullcline”, is the set of values (x,y) such that 


0 


eiTidiiOi — x ) 

V (rf + a 2 ) 3 / 2 


exp 


{x ~ Oi ) 2 ' 

2 (if + cr 2 )_ 


+ ( 1 ~y) 


e 2 T20i 2 {8 2 - x ) 
(rf + a 2 ) 3 / 2 


exp 


(x ~ 6 2 ) 2 ' 

2(r| + a 2 )_ 


This second curve corresponds to ratios y = a t which A — (). The mean trait has a negative 

rate of change (A < 0 ) at points lying below the evolutionary nullcline, and a positive rate of change 
(A > 0 ) for points lying above. In Figure [2] the evolutionary nullclines correspond to the dashed red 
curves. 

Intersections between the ecological and evolutionary nullclines correspond to equilibria of (J2 [) -(|3 [) . 
Since the evolutionary nullcline separates the regions in which A > 0 from the regions in which A < 0 , 
we can use these graphs to identify eco-evo equilibria satisfying the conditions of Theorem 14.11 For 
instance, in Figure [2] the black points correspond to equilibria for which A > 0 for lower x values along 
the ecological curve and A < 0 for higher x values along the ecological curve. Hence, Theorem 14.11 
implies that these black points correspond to stable equilibria for (Ej)-(|3l) whenever h 2 > 0 is sufficiently 
small. Moreover, let [a, b] be an interval of x values for which the ecological curve only intersects the 
evolutionary nullcline at the stable equilibrium. Then for any 6 > 0, Theorem 14.11 implies that the 
basin of attraction for these stable equilibria include the set [5, oo) 3 x [a, b] provided that h 2 > 0 is 
sufficiently small. 

Figure [2] illustrates how changing the carrying capacities of the prey and the strength of the trade¬ 
offs influence long-term eco-evolutionary outcomes. When the trade-off is weak, the ecological and 
evolutionary nullclines intersect at a single point (Fig. [2J4,C). In this case, “most” initial conditions 
(i.e. those for which the initial densities are bounded below by an arbitrarily small 6 > 0) converge to 
this equilibrium provided h 2 > 0 is sufficiently small. Indeed, we conjecture that this unique intersection 
point is globally stable i.e. all positive initial conditions converge to these equilibrium. The conjecture 
following the statement of Theorem 14.11 would imply this result if one could show there is always a 
unique intersection of the evolutionary and ecological nullclines at weak trade-offs. 

When the strength of the trade-off is strong, the evolutionary nullcline becomes “S” shaped and there 
are two stable equilibria (Fig. [2j3,D) . Provided the predator can be sustained on both prey species, the 
predator can evolve to specialize on one of the prey species (Fig. [2)3) . However, if the carrying capacity 
of one of the prey species is too low and the predator is initially too specialized on this prey species, 
then the predator evolves to further specialize on this prey and drives itself to extinction despite the 
possibility of persisting if initially sufficiently specialized on the other prey species (Fig. |2P). 

Figure E] illustrates how the eco-evolutionary dynamics change as the strength of the trade-off in¬ 
creases. At sufficiently low trade-offs, prey species 2 is excluded as the superior prey species (species 
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Figure 3. The effect of trade-off strengths of the eco-evolutionary dynamics at equal (A) 
and unequal (B) prey carrying capacities. Black curves correspond to stable equilibria 
(for low h 2 ) of the ecological state (left) and the evolutionary state (right). Red dashed 
curves correspond to unstable (for low h?) equilibria. Parameters: rq = 1,r 2 = 0.25, K\ = 
100, oq = ct 2 = 0.01, Ti = t 2 = 0.4, er = 0.3, e± = e 2 = 0.5, and d — 0.1. 


1) has a sufficiently large carrying capacity. When the carrying capacities of both prey are sufficiently 
high, the predator always persists at the stable equilibria, but is excluded at an unstable equilibria when 
trade-offs are sufficiently high (Figure EK)- At these higher trade-offs, the system is not permanent. 
However, we conjecture that the system is alm ost-s urely permanent i.e. almost every initial conditions 
converges to an interior attractor |Schreiber . 20041 ]. Theorem 14.11 implies there are two attractors at 
which all species coexist. At one attractor, the predator is more specialized on prey 1 and at the 
other attractor, it is more specialized on prey 2. In sharp contrast, when the carrying capacity of the 
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inferior prey species (species 2) is low and there are sufficiently high trade-offs, one attractor supports 
coexistence of all species, while the predator is excluded at the other attractor (Figure EE>)- 


5. DISCUSSION 


We analyzed a model introduced by ISchreiber et al. 2 0111 ] of two prey species sharing an evolving 
predator. The trait under selection is continuous and influences the predator’s ability to attack the 
prey species. In particular, there is a trade-off in which traits best-adapted for attacking one prey 
species aren’t best-adapted for attacking the other prey species. We show that the strength of this 
trade-off determines whether one of the prey species is excluded, the system is permanent in which 
case coexistence occurs for all initial conditions, or there is contingent coexistence or, more generally, 
multiple attractors. We prove that permanence requires that (i) each prey has a positive per-capita 
growth rate when the predator is specialized on the other prey and (ii) the predator has a positive 
per-capita growth rate at all the fitness extrema when the prey are at their carrying capacities. When 
top-down effects of the predator are strong (e.g. the predator maximal attack rates or prey carrying 
capacities are high), we show that the equilibrium excluding the inferior prey (i.e. the prey with the 
smaller value of ri/a,i(9i )) is stable at sufficiently weak trade-offs. Hence, the community may not 
persist if the predator only experiences weak trade-offs. On the other hand, for sufficiently strong 
trade-offs, the predator has a negative per-capita growth rate at a fitness minimum when the prey are 
at their carrying capacities. Consequently, there are initial conditions leading to the exclusion of the 
predator. In the presence of these strong top-down effects, permanence only occurs at intermediate 
trade-offs which provide the correct balance of reducing the negative indirect effect of the superior 
prey on the inferior prey and the predator phenotypes always having a positive per-capita growth 
rate when the prey are at their carrying capacities. These permanence results highlight how eco- 
evolutionary feedbacks can alter long-term ecological outcomes. They complement earlier work on 
eco-evolutionary dynamics of competin g; spe cies which found eco-evolutionary feedbacks can facilitate 
or 


hinder coexistence |Rael et al. . 2011 . Vasseur et ah . 2011 


When the trait dynamics occur sufficiently slower than the population dynamics, we characterized 
the stable equilibria for the eco-evolutionary dynamics. Moreover, we proved that these stable equilibria 
are nearly globally stable with respect to the ecological state. Namely, provided all species densities 
are not too low and the predator trait is sufficiently close to its equilibrium value, the eco-evolutionary 
dynamics converge to the stable equilibrium. Verifying this characterization using a graphical approach, 
we refined our understanding of the eco-evolutionary dynamics when top-down predator effects are 
strong. Most notably, at strong trade-offs there are two attractors corresponding to the predator 
evolving to specialize on one or the other prey species. If the carrying capacities of both prey species 
are sufficiently high, then all species coexist at these attractors. However, if the carrying capacity of 
one prey species is low, then one attractor corresponds to extinction of the predator. If the predator 
population is initially overly specialized on the prey with the lower carrying capacity, the strong trade¬ 
off results in selection for continued specialization on this prey species despite it ultimately resulting 
in extinction. 

Our analysis highlights the potential importance of eco-evolutionary feedbacks determining long-term 
community structure. However, many challenges remain. We used a quantitative genetics framework to 
model the evolutionary process. While this approach provides a useful first pass on understanding the 
evolution of continuous traits, genetic variances are likely to change overtime and, consequently, it would 
be valuable to model the full distributional dynamics to determine the robustness of the conclusions 
drawn here to this added realism. Comparisons to other models with different genetic architectures, 
such as clonal evolution or sexual reproduction with only a few loci, will help us understand the role of 
this architecture on coexistence. We also assumed that only the predator evolves, but it is likely that 
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the prey would coevolve with the predator. Understanding the resulting eco-evolutionary feedbacks is 
likely to be very challenging, but ultimating crucial for understanding what the role of coevolution in 
stabilizing or destabilizing ecological communities. 


6. Proof of Theorem 13.11 


We begin with some definitions and a restatement of the Corollary to Theorem 2 in iGaravl [19891 ], 
which we use in proving the propositions as well as the main proof. Let E be a closed subset of a 
locally compact metric space (£,d). Define d(z,M ) = inf {d(z,m)\m E Mj, for z E E and M C E. 
Let tt be a dynamical system on E with tt : E x R — > E with tt(z, 0 ) — z and tt(tt(z, t),s) = tt(z, t + s). 
For z E E, a ;(z) = flf>o{7r(^, s)|s E [t, oo)} is the cj- limit, set and a(z) = fl t <o{vr(^, s)|s E (—oo,s]} is 
the a-limit set. The stable set of a compact invariant set M C E is W + (M) = {z E E\oj(z) C M}. 
A compact invariant set A is an attractor provided there is an open neighborhood U of A such that 
nt>oU< j >t{7r(z, s)|z E U} = A. We say that tt is dissipative if there is a compact global attractor S such 
that W+{S) = E. 

A collection M. = {Mi, M 2 , ..., M n } is a Morse decomposition for a tt if Mi, M 2 , ...M n are pairwise 
disjoint, compact, isolated invariant sets with the property that for each z E E there are integers 
i = i{z ) and j = j(z ) with i < j and such t hat u (z) C Mj, a(z) C Mj and if i = j, then z E Mj = Mj. 


Now we can state the theorem from [Garay] [1989 ] 


Theorem 6.1. Let (£,d) be a locally compact metric space. Let tt be a dissipative dynamical system 
on a closed set E C S with maximal compact invariant set S. Let dE C E be a closed invariant set 
and E — E \ dE. If there exists a Morse decomposition M. = {Mi, M 2 ,..., M n } for 7r|S' fl dE (the 
dynamics restricted to S D dE) such that for each i E {1, 2 , ..., n} 

( 1 ) there exists a 7 such that the set {z E E\d(z,Mf) < 7} contains no entire trajectories, and 

(2) E G W+(Mj) = 0 

then tt is permanent, i. e. there exists a (3 such that 

lim inf d{Tr{z, t), dE) > f3 

t—} OO 

for all z E E. 


Note that if E — x R, with the mean phenotype taking any real values then our system is not 
dissipative: when both prey are excluded, every point in {(0, 0, 0, x)\x E R} is a fixed point. Thus, to 
be able to apply Theorem 16.11 we restrict the phenotype space to [9i, 9 2 ] and define E = R{_ x [ 61 , 9 2 }. 
©-© generates a semi-flow tt : R + x E —>■ E. Since ^ > 0 whenever x — 9\ and ^ < 0 whenever 
x = 9 2 , E = R{_ x [9i, 9 2 \ forms a forward invariant set. We define dE = {(A r 1 , N 2 , P, x)\NiN 2 P = 0} 
to be the set in which at least one of the species is excluded, and it follows that E is the set in which 
all three species coexist. 

Dissipativeness of tt follows from a proof similar to that given in Schreiberl . I2Q04L Lemma 4] that 
includes the Lotka-Volterra model of apparent competition. 

To apply Theorem 16.11 to (f2j)-Pj), we begin by proving the two propositions for the two species 
subsystems. We begin with the proof for the predator-prey subsystem. 


Proof of Proposition \3fJ 1 We provide the details of the proof for the case eidi(9i)Ki > d as the com¬ 
plementary case proceeds similarly. For the duration of this proof, let E = R + x {0} x R + x [9i,9 2 \ 
(i.e. the state space restricted to the subsystem without prey 2) and tt denote the semi-flow of ©-(E]) 
restricted to E. Since tt is dissipative, there exists a global attractor S C E. 

We begin by showing that this system is permanent with respect to the boundary set dE = R + x {0} x 
{0} x \9i, 9 2 \ U{0} x R + x {0} x [9i, 9 2 \. To this end, we verify the assumptions of Theorem 16.11 Define 
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E — E \ dE. As ^ = — dP whenever Ni = N 2 = 0, we have S D dE C [0, Ad] x {0} x {0} x [ 6 \, d 2 \. 
A Morse decomposition of tt restricted to S D dE is given by M 4 = {0} x {0} x {0} x [ 61 , 62 ] and 
M 2 = {(A' l7 0, 0, $i)}. To see that Mi is isolated with respect to E and W + (Mi) D E = 0 (i.e. the 
conditions of Theorem 16. Ill , choose e > 0 sufficiently small that riAd(l — N 1 /K 1 ) — d\{ 6 i)NiP > r 4 Ad/2 
whenever Ni < e, P < e. Suppose to the contrary that Mi is not isolated from E. Then there exists an 
invariant set B in E such that maxpv^o,p,s)eB |Ad| + |P| < e. For any solution (Ni(t), 0, P(t),x(t)) with 
initial condition (Ad(0), 0, P(0), x(0)) G B satisfying Ab(0)P(0) > 0, we have that N[(t) > riAd(f)/2 
for all t > 0 which implies lini^oo N\ (t) = 00 . However, this violates the fact that B is bounded. 
Using a similar argument, there can be no initial condition in E whose (n-limit set lies in M\. Hence 

W+(M 1 )HE = 0. 

As eiai(6i)Ki > d, we can find a neighborhood U of M 2 and S > 0 such that e 4 ai(x)Ad — d > 5 
whenever (A r 1 ,0,P, x) G U. Hence, using a similar argument as for the set Mi, we can conclude that 
M 2 is isolated relative to E and W + (M 2 ) n E — 0. Theorem 16.11 implies tt is permanent with respect 
to dE. 

Now consider a solution Ni(t), P(t),x(t) such that Ad(0)P(0) > 0. Since the system is permanent, 
there exists j3 > 0 such that liminf^oo min{Ad(l), P(t)} > /3. Provided Ni > 0, the function 


dW eiNiTiai{ 6 i — x) 
dx (rf + a 2 ) 3 / 2 


exp 


(x 


0i] 


2(rf + cr 2 ) 


has a unique zero at x — 61 , is positive for x < 61 , and is negative for x > 6 \. Since Ni{t ) > j3 /2 for t 
sufficiently large, it follows that lim^ 0O a:(t) — &i. As the ecological dynamics (J2J) with the fixed value 
of x — 61 h as a g l oba l stable equilibria positive equilibrium (d/(eidi(6i)), ^(1 — Ni/Ki)/di(6i),6i), 

Theorem 1.8] implies the ca-limit set of (Ni(t), P(t),x(t)) is this equilibrium. 

□ 


Mischaikow et ah 1995 


Next we prove the proposition for the two prey subsystem. 


Proof of Proposition 13.SI Assume (N 1 (t),N 2 (t),0,x(t)) is a solution to (j2])-([3]) with A" 1 (0)A r 2 (0) > 0. 
Prey species i experiences logistic growth, so linq^oo N^t ) = Ad for i — 1,2. Let A = {(Ad, K 2 , x)\x G 
M}, which is invariant, since ^ = 0 for i = 1,2. Let f(x) = a%^-(Ki, K 2 , x) be the pheno- 


type dynamics when = K, for i = 1,2. Mischaikow et al. |1995l Theorem 1.8] implies that 


ca((Ad(0), Af 2 (0), 0, x(0))) C {(Ki,K 2 ,0,x)\f(x) = 0}. Since / is an analytic function and f(x) < 0 
for x sufficiently negative or positive, the zeros of / are isolated. Since an cu-limit is a connected set, 
a;((Ad(0), Ad(0), 0, x(0))) is a single point in {(Ad, AT 2 , 0, x)\f(x) = 0}. □ 


Now, we prove the main theorem. Without loss of generality, assume di( 6 i)eiKi > a 2 (0 2 )e 2 A' 2 . 
Then, there are three cases to consider: (i) d > di{ 6 i)eiKi, (ii) di( 6 \)eiKi > d > a 2 (6 l 2 )e 2 A' 2 or (iii) 
d 2 { 6 2 )e 2 K 2 > d. 


Recall that E = M'| x [ 6 \, 6 2 \. Since tt is dissipative in E , there is a global attractor S C E. For each 
of the three cases, we claim there is a Morse decomposition for tt\S D dE that satisfies the assumptions 
of Theorem 16.11 

We start with case (iii). Let A 4 = {M 6 , M 5 , M 4 , M 3 , M 2 , Mi}, where M 6 = {(0, 0, 0)} x [ 61 , & 2 ], M 5 = 
{{Ki, 0, 0, 61 )}, M 4 = {(0,K 2 ,0,6 2 )},M 3 = {(Ni,0,Pi,6i)}, M 2 = {(0, N 2 , P 2 , 6 2 )} where N, = 


and Pi = , and M 4 = {(Ad, AT 2 ,0)} x [ad,x 2 ] where X\ = min se Q x and x 2 = max se qx. 

We claim that Al is a Morse decomposition for S D dE. We need to verify the oj-limit and a-limit 
sets property of Morse decompositions. Let z G (S fl dE) \ Al, where 0 = (Ad, Ad, P, x). Then, one of 
the following holds: 
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(a) N 2 = P = 0, Ni > 0 

(b) N 2 = 0, iVi > 0, P > 0 

(c) Ni = P = 0, N 2 > 0 

(d) Ni = 0,N 2 > 0,P > 0 

(e) P = 0, Ni > 0, N 2 > 0 


If (a) holds, then u(z) = M 5 and a(z) C M 6 . If (b) holds, then Proposition 13.11 implies that 
u:{z) = M 3 . The invariance of g-limi ts and Propos ition 13.11 imply a(z) C {(N\, N 2 , P,x)\NiP = 

0, N 2 = 0} U M 3 . Then, by Mischaikow et al. 1995, Proposition 1.5], a(z) C M 6 , a(z) = M 5 , or 
a(z) = M 3 . Since (Ni,Pi) is globally stable for 7 r|{(lVi, 0, P, 0i)|lVi, P G M}, and ^ < 0 whenever 
N 2 = 0 and x > 9i, co(z) — a(z) = M 3 implies that z G M 3 . Cases (c) and (d) follow similarly. If (e) 
holds, then uj(z) C M\ , by Proposition 2, and either a(z) C M 5 , a(z) C M 4 , or a(z) C M 6 . 

Thus, we have shown that _M 3 forms a Morse decomposition for n\S D dE for case (iii). 

Finally, we verify the two assumptions of Theorem 16.II using arguments similar to those made in the 
proof of Proposition 13.11 To show that Mi is isolated for E and W + (Mi) HE = 0, recall by assumption 
that eidi(x*)Ki + e 2 a 2 (x*)K 2 > d for all x* G Q. Hence, there exists a neighborhood U of Mi and 5 > 0 
such that eid\(x)Ni + e 2 d 2 [x)N 2 — d > S for all (Ni, N 2 , P, x) G U. Now suppose to the contrary that 
Mi is not isolated from E or W + {M \) D E ^ 0. Then there exists a solution N 2 (t), P(t), x(t)) 

which lies in U fl E for all t > 0 . But this implies that P'(t) > SP(t ) for all t > 0 and, consequently, 
lini/^oo P(t) = 00 , a contradiction. We can use the same type of argument to show that M,; is isolated 
from E and W + (Mi ) fl E = 0 for i = 2,..., 6 . Specifically, for M 6 , we use a neighborhood U and 6 > 0 
such that ri(l — Ni/Ki) — di(x)P > 5 for all (Ni , N 2 , P, x) G U. For M 5 and M 4 , we use a neighborhood 
U of M 5 UM 4 and 8 > 0 such that e\di(x)Ni + e 2 d 2 (x)N 2 — d>5ioi all (Ni, N 2 , P, x) G U. For M 3 , we 
use a neighborhood U of M 3 and <5 > 0 such that r 2 (l — N 2 /K 2 ) — d 2 (x)P > 5 for all (Ni, N 2 , P, x) G U. 
Finally, for M 2 , we use a neighborhood U of M 2 and <5 > 0 such that ri(l — Ni/K 1 ) — d\{x)P > 8 for 
all (N \, N 2l P, x) G U. It follows that by Theorem 16.11 tt |E is permanent for case (iii). 

We can provide permanence for cases (i) and (ii) in a similar manner using slightly different Morse de¬ 
compositions. Specifically, for case (i), we can use the Morse decomposition given by M. = {M 4 , M 3 , M 2 , M 4 }, 
where M 4 = (0,0,0) x [0i,0 2 ],M 3 = (iP 4 , 0, 0, 0i), M 2 = (0, K 2 , 0, 0 2 ), and M, = [x 4 ,x 2 ] x (Ad,A' 2 ,0). 

For case (ii), we can use the Morse decomposition given by M. = {M 5 , M 4 , M 3 , M 2 , M 4 }, where 
^5 — [^ij ^ 2 ] x (0, 0, 0), M 4 = (A 1; 0, 0, 0 4 ), M 3 = (0, A 2 , 0, 0 2 ), M 2 = (Ay, 0, P 1 , 9i), and M x = [x 4 , x 2 ] x 
(Ad,Ab,0). 

Next, we extend our proof to any initial phenotype in x(0) G M and A"i(0)A' 2 (0)P(0) > 0. First note 
that there exists a 8 such that lim sup^^ max{A r i(t), N 2 (t)} > 8 . It follows that there exists a 7 such 
that whenever x(t) < 9 \ 1 there is a range [t + Si,t + s 2 ] with > 0 and s 2 > 0 such that (|- > 7 . Thus, 
there exists a Tf, such that x(Xi) > 9\. Similarly, we can show there exists T 2 such that x{T 2 ) < 9 2 . 

Finally, if inequality (a) in the statement of Theorem 13.11 is reversed for i — 2, then the Jacobian 
matrix at 


(W,iV 2 ,P,x) = 


d 


e 1 a 1 (9 1 


-,o, 


P(l-fe) 

di(9i) 


,9 1 


has the following sign structure in the Ni, P,x, N 2 coordinate system 


/— — * * \ 

+ 0 * * 

0 0 — * 

\0 0 0 -) 
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where * indicates a term with a positive, negative or zero sign. This matrix has an upper triangular 
block structure with 2x2, lxl, and lxl blocks down the diagonal. Each of these diagonal blocks 
has a sign structure that implies the eigenvalues of these blocks have negative re al parts. Hence, 


this equilibrium is stable by the stable manifold theorem, see e.g. (Guckenheimer and Holniesl . 1983 


Theorem 1.3.2], Alternatively, the partial converse when inequality (b) in th e stat em ent o f Th eore m 13.II 


is rev ersed follows immediately from the center manifold theorem, see e.g. G ucke nheimer and Holmes), 


1983 . Theorem 3.2.1], 


7. Proof of Theorem 14.11 


Dehn eg(x) = ^-(N±(x), N 2 (x), x). For any set / C [9±,9 2 ], define £(/) = {(N\(x), N 2 (x), P(x), x)\x G 
/}. Let r] > 0 be such that J — [x* — rj, x* + rj\ C (a, b ) and the graph of £(J) is continuously differen¬ 
tiable. 

Choose a compact neighborhood U of £([a, b]) such that (i) there exists a hi > 0 such that the 
maximal invariant set 1(h) in V — U fl x J for (|2j)-(l3l) with 0 < h < h\ is contained in a forward 
invariant set that is homeomorphic to a closed interval, (ii) U is forward invariant and contains the global 
attractor for the dynamics of (Ef)-d3J) for h — 0 restricted to (0, oo ) 3 x [a, b], (iii) ^(Afi, N 2 , x) > 0 for all 
(Ni, N 2 , P, x) G f/flM 3 x [a, x~g\ and ^-(Ni, N 2 , x) < 0 for all (x, Ni, N 2 , P) G U flM 3 x [ x + r /, b], and (iv) 


(N±(x*), N 2 (x 2 ), P(x*),x*) is the only equilibrium in V for ©-© for h > 0. A neighborhood satisfying 
the first condition follows from geometric singular perturbation theory [FenicheJ . 197ll . Theorem 1], A 
possibly smaller neighborhood satisfying the second condition follows from £([a,b]) being a global 
attractor for the dynamics of h = 0 restricted to [a, b] x ikj_. A possibly even smaller neighborhood 
satisfying the third condition follows from our assumption that g(x) > 0 for x G [a, x*) and g(x*) < 0 
for x G (x*,b\. Finally, a possibly even smaller neighborhood satisfying the fourth condition follows 
from the equilibria of ©-(ED being independent of h > 0, and our assumption that (N 2 (x), Ni(x), P(x) 


being stable for the ecological dynamics and ^(Ni(x) : N 2 (x), P(x)) ^ 0 in [a,b\ except at x*. 

Let C = [e/2, M] 3 x [a, b] (here M is chosen so that [0, M] 3 x [9i, 0 2 ] contains the global attractor for 
the dynamics.) For h = 0, compactness of K , condition (ii), and continuous dependence of solutions 
on initial conditions implies that there is a T > 0 so that any solution starting in K enters U by time 
T. Continuity of the solutions of ©-(ED with respect to the initial conditions and parameters, and 
compactness of C implies that this holds for any h G [0, h 2 \ for h 2 > 0 sufficiently small. 

Let h 0 = min{ h i, h 2 } and choose h G (0, h 0 ). For any initial condition in K , (iV/f), N 2 (t), P(t),x(t)) G 
U for all t > T. As ^ > 0 in U fl R 3 x [a, x* — g] and ^ < 0 in U fl M 3 x [x* + rj, b\, this solution 
enters and remains in V for all t sufficiently large. In particular the w-limit set of the solution must 
lie in V. As the maximal invariant set in V is contained in a forward invariant set homeomorphic to a 
closed interval and the only equilibrium in V is (Ni(x*),N 2 (x*),P(x*),x*) (see condition (iv) above), 
the maximal invariant set is this equilibrium. In particular, the (u-limit set of the solution is this 
equilibrium and the proof is complete. 
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